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(54) Multithreaded processor for processing multiple instruction streams independently of each 
other by flexibly controlling throughput in each instruction stream 



(57) A multithreaded processor for executing multi- 
ple instruction streams is provided. This multithreaded 
processor includes: a plurality of functional units for ex- 
ecuting instructions; a plurality of instruction decode 
units, corresponding to the multiple instruction streams 
on a one-to-one basis, for respectively decoding an in- 
struction, and Producing an instruction issue request for 
designating to which functional unit the decoded instruc- 
tion should be issued and requesting for the issuance 
of the decoded instruction to the designated functional 
unit: a holding unit for holding the priority level of each 
instruction stream; and a control unit for deciding which 
decoded instruction should be issued to a functional unit 
designated by two or more instruction issue requests at 
the same time, in accordance with the priority levels held 
by the holding unit. 
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D script! n 

BACKGROUND OF THE INVENTION 

(1) FIELD OF THE INVENTION 

The present invention relates to an information 
processor which efficiently utilizes a plurality of execu- 
tion units by issuing instructions from multiple instruction 
streams in parallel. 

(2) RELATED ART 

Conventionally, a multi threaded processor has 
been employed to process multiple instructions in par- 
allel, which is fully descried in "A Multithreaded Proces- 
sor Architecture with Simultaneous Instruction Issuing" 
In Proc. of Iss' 91: International Symposium on Super- 
computing, Fukuoka, Japan, pp.87-96, November 
1991. 

FIG. 1 is a block diagram showing the structure of 
the conventional multithreaded processor. As can be 
seen from this figure, the multithreaded processor is 
provided with an instruction cache 500, three instruction 
fetch units 501, three decode units 502, twelve standby 
stations 503, four instruction schedule units 504, four 
functional units 505, and a register set 506. Here, three 
instruction streams corresponding to the three pairs of 
instruction fetching units and decode units in the figure 
are executed in parallel. An "instruction stream" means 
a process performed by a pair of an instruction fetch unit 
and a decode unit. 

The instruction fetch unit 501 extracts instructions 
from the instruction cache 500. 

The decode unit 501 decodes the instructions of 
each instruction stream, and then stores the decode re- 
sults (hereinafter referred to simply as "instructions") in- 
to the standby stations 503 connected to the functional 
units 505 which are capable of processing the instruc- 
tions. 

The instruction schedule units 504 selects instruc- 
tions from the standby stations 503, and sends them to 
available functional units 505. If the decoded instruction 
results of different instruction streams for the same one 
functional unit are stored in the standby stations 503, 
the instruction selection is performed in fixed order, so 
that processing can be fair among the instruction 
streams. 

Each of the functional units 505 executes the in- 
structions from the standby stations 503 using the reg- 
ister set 506. The functional units 505 may be ail the 
same, but in many cases, they consist of various types, 
such as a load/store unit, an integer arithmetic logic unit, 
floating-point arithmetic unit, and a multiply/divide unit. 

The following is an xplanation of the operation of 
the multithreaded processor structured as above. 

Being provided with three pairs of the instruction 
fetch units 501 and the decode units 502, the multi- 



threaded processor shown in FIG: 1 can f ten and de- 
code three instruction streams in parallel. As for the re- 
lationship between the three instruction streams and the 
programs in the instruction cache 500 (or in the main 

s memory not shown in the figure), one program may cor- 
respond to one instruction stream (that is, the three in- 
struction streams are generated by three programs), or 
one program may correspond to multiple instruction 
streams (that is, the three instruction streams are gen- 

10 erated by one program). The latter includes the case 
where one image processing program is performed as 
multiple instruction streams with respect to different im- 
age data. 

Instruction decoded by the decode units 502 are is- 

15 sued to the functional units corresponding to the instruc- 
tions via the standby stations 503 and the instruction 
schedule units 504. Each functional unit executes any 
instruction issued from any instruction stream. 

As described so far, the multithreaded processor is 

20 characterized by processing multiple instruction 
streams in parallel using execution units shared by the 
multiple instruction streams. 

As one multithreaded processor processes multiple 
instruction streams inside itself, one unit for executing 

2B one instruction stream will be hereinafter referred to as 
a logical processor. 

Each logical processor has a decode unit, an in- 
struction sequence control mechanism, and a register 
set, so as to process an instruction streams independ- 

30 ently of each other. Functional units and a cache mem- 
ory are shared by a plurality of logical processors. 

Meanwhile, the overall processor will be hereinafter 
referred to as a physical processor in contrast with the 
logical processors. 

35 Unlike the multithreaded processor, a conventional 
superscalar processor can process only one instruction 
stream at a time, because only the functional units are 
multiplexed. Furthermore, pipeline interlock frequently 
occurs in the superscalar processor due to the depend- 

40 ence between instructbns. For the above reasons, it js 
difficult to improve the efficiency of the functional units 
and the throughput of the superscalar processor. Mean- 
while, the above-mentioned multithreaded processor 
processes multiple instruction streams so as to improve 

45 efficiency of the functional units and throughput of the 
processor itself. 

However/the multithreaded processor of the above 
structure has the following problems. 

The first problem is that since a plurality of logical 

so processors shares the same functional units, several in- 
structions issued from multiple instruction streams com- 
petes for the functional units. This dramatically reduces 
the number of instruction issues of a specific logical 
processor, d teriorating effici ncy of the specific logical 

55 proc ssor. In the case where th load greatly varies 
among the logical processors, even if instruction 
streams having the same process content (generat d 
by the same program) are allocated to the logical proc- 
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essors one by one, the process of a specific instruction 
stream will be delayed, resulting in variation in finish 
time of the processes and preventing the processes 
from speeding up: 

The second problem is that even if instruction 
streams having different process contents are allocated 
to the logical processors and a specific instruction 
stream is intended to be processed first, the process., 
speed of the specific logical processor cannot be in- 
creased, and the specific logical processor cannot oc- 
cupy the shared resource. For these reasons, the over- 
all efficiency decreases. This case applies to the case 
where an urgent interrupt occurs, for example. 

SUMMARY OF THE INVENTION 

The object of the present invention is to provide a 
multithreaded processor which can flexibly control the 
efficiency in execution of each instruction stream so as 
to improve the overall throughput. 

The above object can be achieved by providing a 
multithreaded processor for executing multiple instruc- 
tion streams. This multithreaded processor comprises: 
a plurality of functional units each for executing an in- 
struction; a plurality of instruction decode units corre- 
sponding to the multiple instruction streams on a one- 
to-one basis, each for decoding an instruction, and pro- 
ducing an instruction issue request for designating to 
which functional unit the decoded instruction should be 
issued and requesting for the issuance of the decoded 
instruction to the designated functional unit; a holding 
unit for holding priority level of each of the instruction 
streams; and a control unit for deciding which decoded 
instruction should be issued to a functional unit desig- 
nated by two or more instruction issue requests at the 
same time, in accordance with the priority levels stored 
by the holding units. . 

With this structure, the instruction to be issued to 
each functional unit (or the decode result of the instruc- 
tion) is determined in accordance with the priority levels, 
so that the variation of load among the multiple instruc- 
tion streams can be flexibly adjusted in accordance with 
the priority, levels. Thus, the efficiency required for exe- 
cuting each instruction stream can be properly attained 
so as to improve the overall throughput of the processor. 

The object of the present inventbn can also be 
achieved by providing a multithreaded processor having 
the same structure as the above-mentioned multi . 
threaded processor, except that the holding unit further 
has flags which can be set by an instruction for indicating 
wh ther each instruction stream should be halted or ex- 
ecuted,. and the control unit includes: an arbitration unit 
for making the decision; and a stop unit for stopping an 
instruction stream corresponding to a flag indicating a 
halt by excluding the instruction issue requests of the 
instruction streams corresponding to the flags in making 
the d cision. 

With this structure, an instruction stream in an idle 



state or in a wait state can be put into a halt state. As a 
result, priority can be given to the remaining instruction 
streams, so as to improve the overall throughput. 

The . object of the present invention can also be. 
5 achieved by providing a multithreaded processor having 
the same structure as the above-mentioned multi 
threaded processor, except that the control unit f urther 
includes a prohibition unit for temporarily prohibiting is- 
suance of the instruction decided to be issued by the 
control unit to the functional unit, if there is a process 
which needs to be processed urgently in an instruction 
stream to which the instruction belongs. 

According to this structure, if an interrupt occurs to 
an instruction stream (or a logical processor), the prohi- 
bition unit temporarily prohibits the logical processor 
from issuing an instruction. In other words, the prohibi- 
tion unit temporarily prohibits instruction issuance dur- 
ing a predetermined number of cycles required tor mov- 
ing to the interrupt process. Thus, the transition to the 
interrupt process can be expedited. Furthermore, the 
prohibition unit can prohibit the issuance of an instruc- 
tion even after the arbitration unit has decided the issu- 
ance of the instruction, so that an issuance prohibition 
can be issued even'if an urgent process occurs after the 
arbitration unit has made a decision. For instance, even 
if there is a process to be urgently performed at a later, 
stage during a machine cycle, instruction issuance can 
be prohibited. 

The object of the present invention can also be 
achieved by providing a multithreaded processor having 
the same structure as the above-mentioned multi- . 
threaded processor, except that one of the functional 
units receives a special instruction for ordering to 
change the priority level of an instruction stream to 
which the special instruction belongs, the priority level 
being one of the priority levels held by the holding unit' 
The object of the present invention can also be 
achieved by providing a multithreaded processor having 
the same structure as the above-mentioned multi- 
threaded processor, except that the special instruction 
is made up of only an operation code for indicating 
whether the priority levels should be raised or lowered, 
and that one of the functional units detects which in- 
struction decode unit has issued the special instruction 
in the case where a decode result of the special instruc- 
tion is issued, and then raises or lowers the priority level, 
of an instruction stream corresponding to the detected 
instruction decode unit. 

According to this structure, the special instruction 
does not require operands indicating the bit positions to 
specify instruction streams and the IDs of the instruction 
streams. For this reason, the priority level of each in- 
struction stream can be- readily changed by. the same 
instruction. 

.Since the priority level of the instruction stream to 
which the instruction belongs is changed by one func^ 
tional unit, oth r instruction streams are not inadvertent- 
ly rewritten. Thus, malfunction can be prevented. For in- 
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stance, when performing the sam image processing on 
RGB color image data, that is, when executing one im- 
age processing program as three instruction streams si- 
multaneously and independently of each other, informa- 
tion can be opacified (there is no need to distinguish be- 
tween the programs for R, G, and B), and the independ- 
ence of each instruction stream can be guaranteed/As 
a result, the reliability of the OS and the overall system 
can be improved. 

The object of the present inventbn can also be 
achieved by providing a multithreaded processor having 
the same structure as the above-mentioned multi- 
threaded processor, except that the holding unit in- 
cludes a control register which has a first field for read 
only, and that one of the functional units detects which 
instruction decode unit has issued a read instruction 
when the decode result of the read instruction of the con- 
trol register is issued, and outputs the ID of the instruc- 
tion stream corresponding to the detected instruction 
decode stream as the read data of the first field to an 
internal bus. 

According to this structure, if three instruction 
str ams derived from one program are executed simul- 
taneously and independently of each other as described 
above, three virtual programs which are derived from 
on program are executed in parallel. The ID of each 
virtual program (or each instruction stream) can be eas- 
ily obtained by reading out the first field. 

The object of the present inventbn can also be 
achieved by providing a multithreaded processor having 
the same structure as described above, except that the 
holding unit has a control register which includes indi- 
vidual fields corresponding to the multiple instruction 
streams on a one-to-one basis for holding inherent data 
of the multiple instruction streams, and a second field 
for read only, and that one of the functional units reads 
out the individual field of each of the multiple instruction 
streams upon execution of a read instruction of the con- 
trol register, and outputs the inherent data of the instruc- 
tion stream corresponding to the instruction decode unit 
that has issued the read instruction as the read data of 
the second field to the internal bus. 

According to this structure, the priority level of the 
above-mentioned can be easily obtained by reading out 
the second field. 

The object of the present invention can also be 
achieved by providing a multithreaded processor having 
the same structure as described above, except that the 
holding unit includes priority fields for holding the priority 
I vel of each instruction stream, that the priority field of 
each instruction stream is made up of minor fields indi- 
cating the priority level of each instruction stream in 
each execution mode, and that one of the functional 
units detects which instruction decode unit has issu d 
the sp cial instruction in the case where the decode re- 
sult of the special instruction is issued, and then raises 
or lowers the priority level of each minor field for the cur- 
rent execution mode among the priority fields of the in- 



struction stream corresponding to the detected instruc- 
tion decode unit. 

According to this structure, the priority levels can be 
set separately for user mode and supervisor mode, and 

5 when returning from another mode, the original priority 
levels can be retained. 

The object of the present invention can also be 
achieved by providing a multithreaded processor having 
the same structure as described above, except that it 

w further comprises: a specified instruction detecting unit 
for detecting that one of the functional units has started 
executing a specified instruction, and which instruction 
decode unit has issued the decode result of the speci- 
fied instruction; and a temporary modification unit for 

15 temporarily modifying, if the specified instruction detect- 
ing unit has detected the execution start of a specified 
instruction. Here, the priority level of the instruction 
stream corresponds to the instruction decode unit which 
has issued the specified instruction over a predeter- 

20 mined period of time, and the priority level is modified 
so as to be higher than the priority levels of other instruc- 
tion streams. 

According to this structure, since the temporary 
modification unit temporarily changes the priority levels, 

2S the instruction string starting with the specified instruc- 
tion in each instruction stream is always executed in 
continuous cycles. 

The object of the present invention can also be 
achieved by providing a multithreaded processor having 

30 the same structure as described above, except that it 
further comprises an exclusive halt data holding unit for 
holding exclusive halt data for each instruction stream, 
the exclusive halt data indicating that one instruction 
stream should be in an execution state, and that the re- 

35 maining instruction streams should be in a halt state. 
Here, the stop unit stops notifying the arbitration unit of 
the issuance of an instruction issue request from the in- 
struction decode unit corresponding to instruction 
streams kept in a halt state by the exclusive halt data 

40 According to such a structure, one instruction 
stream can forcibly stops the execution of other instruc- 
tion streams. Thus, the throughput can be adjusted over 
a wide range among the instruction streams. 

The object of the present invention can also be 

45 achieved by providing a multithreaded processor which 
executes multiple instruction streams simultaneously 
and independently of each other. This multithreaded 
processor comprises: a plurality of instruction cache 
units for temporarily storing instructions of the multiple 

so instruction streams; a plurality of instruction fetch units 
corresponding to the multiple instruction streams on a 
one-to-one basis, each for fetching an instruction of 
each instruction stream from the instruction cache units; 
a priority designating unit lor d signating the priority lev- 

55 | of each of the multiple instruction stream; and an in- 
struction fetch control unit for arbitrating between in- 
. struction fetch requests issued by two or more instruc- 
tion cache units, in accordance with the priority levels 
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designated by the priority designating unit. 

According to this structure, the competition among 
fetch requests from the plurality of instruction fetch units 
is arbitrated when they compete for one instruction 
cache unit. Thus, the throughput of each instruction 
stream can be flexibly adjusted in the upstream of the 
multithreaded processor. 

The object of the present inventbn can also be 
achieved by providing a multithreaded processor pro- 
vided with a plurality of functional units for executing in- 
structions, a Plurality of instruction decode units for de- 
coding an instruction fetched from an instruction cache 
unit and outputting an instruction issue request to a des- 
. ignated functional unit, and the same number of register 
sets as the instruction decode units, which executes the 
same number of instruction streams as the instruction 
decode units simultaneously and independently of each 
other. This multithreaded processor comprises: a hold- 
ing unit for holding the priority level of each instruction 
stream that can be set by an instruction in each instruc- 
tion stream; and a control unit for arbitrating between 
two or more instruction streams sharing the same re- 
source, in accordance with the priority levels. Here, the 
shared resource is afunctional unit for which instruction 
issue requests from two or more instruction decode 
units compete, or an instruction cache unit, for which 
fetch requests from two or more instruction decode units 
compete, or one register set for which access requests 
from two or more functional units compete. 

According to this structure, if execution requests 
from multiple instruction streams compete for the 
shared resource, the competition among them will be 
arbitrated in accordance with the priority levels. Thus, 
the throughput of each instruction stream can be flexibly 
adjusted. 

BRIEF DESCRIPTION OF THE DRAWINGS 

These and other objects, advantages and features 
of the invention will become apparent from the following 
description thereof taken in conjunction with the accom- 
panying drawings which illustrate a specific embodi- 
ment of the invention. In the drawings: 

FIG. 1 is a block diagram showing the structure of 
a conventional multithreaded processor. 

FIG. 2 is a block diagram showing the structure of 
a multithreaded processor of an -embodiment of the 
present invention. 

FIG. 3 shows the priority designating register of the 
instruction stream control unit in the embodiment of the 
present invention. 

FIG. 4 shows the lower 2 bits of the priority desig- 
nating register of the instruction stream control unit in 
the embodiment of the present invention. 

FIG. 5 shows the high r 1 bit of th priority desig- 
nating register of the instruction stream control unit in 
the embodiment of the present invention. 

FIG. 6 shows the structure of the internal interrupt 



register of the instruction stream control unit in the em- 
bodiment of the present invention. 

FIG. 7 shows the structure of the exclusion stop r g- 
ist r of the instruction stream control register in the em- 
5 bodiment of the present invention. 

FIG. 8 is a block diagram showing detailed example 
structure of the instruction issue deciding unit in the em- 
bodiment of the present invention. 

FIG. 9 is a block diagram showing a detailed exam- 
ple structure of the instruction issue arbitration unit in 
the embodiment of the present invention. 

FIG. 10 shows the control logic of the priority judg- 
ing unit in the embodiment of the present invention. 

FIG. 11 is a block diagram showing a detailed ex- 
ample structure of the instruction issue prohibition unit 
in the embodiment of the present invention. 

FIG. 12 shows the contents of an exclusive instruc- 
tion for a functional unit and a fetch instruction for a con- 
trol register. 

FIG. 1 3 is a block diagram showing a detailed struc- 
ture of the priority control unit. 

FIG. 14 shows the relationship between select sig- 
nals inputted into the selector inside the continuous cy- 
cle prioritized unit and output values of the selector. 

FIG. 1 5 is a block diagram showing a multithreaded 
processor of another embodiment of the present inven- 
tion. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[Structure of Multithreaded Processor] 

FIG. 2 is a block diagram showing the structure of 
the main components of a multithreaded processor of 
an embodiment of the present invention. 

The multithreaded processor comprises instruction 
decode units 1 to 3, functional units A20, B21 ,.C22, and 
D23, an instruction issue deciding unit 30, an instruction 
issue arbitration unit 40, an instruction issue prohibition 
unit 50, a priority control unit 60, and an instruction se- 
lecting unit 70. The multithreaded processor is made to 
arbitrate instruction issuance to each functional unit in 
accordance with the execution status, priority of the in- 
struction streams, and external factors. 

The multithreaded processor comprises an instruc- 
tion cache; instruction fetch units, and register files 
shown in FIG. 1, though they are not shown in FIG. 2. 
Likewise, explanations of detailed structures, such as 
the number of pipeline stages of each functional unit, 
are not provided below. For ease of explanation, in this 
embodiment, each instruction decode unit decodes one 
instruction from one instruction stream. and one instruc- 
tion is issu data time. 

In FIG. 2, the instruction decode units 1 to 3 decode 
instructions of the respective instruction streams, and 
output as the decode results an instruction issue request 
to the instruction issue deciding unit 30, and the instruc- 
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tion contents (operations) to the instruction s lecting 
unit 70. The instruction issue request contains a flag for 
requesting instruction issuance (hereinafter referred to 
as "request flag"), and information as to which functional 
unit processes the instruction (this information will be 
hereinafter referred to as 'functional unit number"). As 
the instruction decode units 1 to 3 decode the instruction 
streams independently of each other, they correspond 
to the above logical processors. Since three logical 
processors are contained in one physical processor, the 
number of instruction decode units provided in this em- 
bodiment is three. Hereinafter, the logical processors 
corresponding to the instruction decode units 1 to 3 will 
be referred to as logical processors 1 to 3. Likewise, the 
instruction streams corresponding to the logical proces- 
sors 1 to 3 will be referred to as instruction streams 1 to 
3. 

The functional units A20, B21 , C22, and D23 (here- 
inafter referred to as functional units A, B, C, and D) ex- 
ecute instructions (or decode results) issued from the 
instruction decode units 1 to 3 via the instruction select- 
ing unit 70, that is, they perform data access and arith- 
metic operations. The function of each functional unit is 
the same as one another, but an example is described 
below for ease of explanation. 

The functional unit A is a load/store unit for execut- 
ing a memory access instruction, the functional unit B is 
an integer arithmetic unit for performing an integer arith- 
metic, the functional unit C is a floating-point unit for per- 
forming floating-point addition and subtraction, and con- 
verting between an integer and a floating-point number, 
and the functional unit D is a floating-point unit for per- 
forming floating-point multiplication and division. The 
functional un it B of this embodiment further has the func- 
tion of executing an instruction concerning the setting of 
priority as part of integer calculation process. These 
functional units are components of the logical proces- 
sors 1 to 3, but do not correspond to them one by one. 
The functional units are shared by the logical processors 
Tto 3. Each functional unit also notifies the instruction 
issue deciding unit 30 whether it is ready to receive an 
instruction or hot (the status of each functional unit will 
be hereinafter referred to simply as "ready" or "not 
ready"). 

The instruction issue deciding unit 30 judges to 
which functional unit an instruction should be issued, up- 
on receipt of an instruction issue request (the above- 
mentioned request flag and functional unit number) from 
the instruction decode units 1 to 3. According to a notice 
from each functional unit as to whether it is ready to re- 
ceive an instruction and a notice from the priority control 
unit 60 as to whether each logical processor is in a halt 
state or in an execution state, the instruction issue de- 
ciding unit 30 further judges whether an instruction can 
be issued to each of the functional units A to D. 

The instruction issue arbitration unit 40 arbitrates 
between the instruction issue r quests to determine one 
instruction to be issued in accordance with the priority 



designated by the priority control unit 60 for each logical 
processor, in the case where a plurality of instruction 
issue requests compete for one functional unit. 

The instruction issue prohibition unit 50 definitely 

s judges whether the instruction should be issued and in- 
forms the instruction selecting unit 70 of the instruction 
issuance, upon receipt of the arbitration result of the in- 
struction issue arbitration unit 40. More specifically, if an 
instruction to be urgently processed is issued to each 

10 logical processor, the instruction issue prohibition unit 
50 temporarily inhibits the issuance of instruction from 
the instruction stream of the logical processor, and if 
there are no emergencies, the instruction issue prohibi- 
tion unit 50 orders the instruction selecting unit 70 to 

is issue an instruction. The reason the instruction issue 
prohibition unit 50 temporarily prohibits instruction issu- 
ance is that when there is an instruction to be urgently 
processed as described above after the operations of 
the instruction issue deciding unit 30 and the instruction 

20 arbitration unit 40, the instruction should be given top 
priority. Furthermore, the instruction issue prohibition 
unit 50 can prohibit the issuance of an instruction even 
after the instruction issue arbitration unit 40 has decided . 
the issuance of the instruction, so that an issuance pro- 

25 hibition can be issued even if an urgent process occurs 
after the instruction issue arbitration unit 40 has made 
a decision. For instance, even if there is a process to be 
urgently performed at a later stage during a machine cy- 
cle, instruction issuance can be prohibited. 

30 The priority control unit 60 controls the priority level 
of each logical processor, and alsocontrols the informa- 
tion showing whether each logical processor is in an ex- 
ecution state or in a haft state. It then informs the instruc- 
tion issue arbitration unit 40 of the priority level, and the 

35 instruction issue deciding unit 30 of whether each logical 
processor is in an execution state or not. The priority 
control unit 60 further has a function of giving priority to 
the logical processor during a predetermined number of 
continuous cycles (this function will be hereinafter re- 

40 ferred to as "continuous cycle prioritizing function"). To 
control the information as to the priority and whether it 
is in an execution state, the priority control unit 60 com- 
prises three control registers, that is, a priority designat- 
ing register, an internal interruption register, and exclu- 

45 sive halt register. These registers have values set in ac- 
cordance with instructions of the instruction streams. 

The instruction selecting unit 70 issues instructions 
(operation instructions) decoded by the instruction de- 
code units 1 to 3, to the functional units A to D, in re- 

50 sponse to an instruction issue command designating the 
instruction issuer decode unit and the recipient function- 
al unit. 

[Priority Control Unit 60; Priority D signating Register] 

55 

FIG. 3 shows the bit configuration of the priority des- 
ignating register (her inafter referred to as "PRi regis- 
ter") contained in the priority control unit 60. 
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As can be seen from the figure, the PR! register has 
fields MYID, PRI3, PRI2. PRI1. and MYPRI. and holds 
the information as to the priority of each logical proces- 
sor and whether each logical processor is in a halt state. 

The MYID field indicates the ID of the logical proc- 
essor which executes a read instruction for the PRI reg- 
ister. If the read instruction is executed in the logical 
processor 3, the ID indicating the logical processor 3 
. ("1 00", for instance) is read out. 

The PRI3 indicates the priority of the logical proc- 
essor 3 and whether the logical processor 3 is in a halt 
state. 

The PRI2 and PRI1 fields indicate the same as the 
PRI3 with respect to the logical processors 2 and 1, re- 
spectively. 

The MYPRI field indicates the priority of the logical 
processor which executes the read instruction for the 
PRI register. For instance, the content of the PRI1 field 
is copied and then read out upon execution of the read 
instruction in the logical processor 1 . • • 

FIG. 4 shows each lower 2-bit allocation of the PRI3 
to PRI1 fields in the PRI register. In this figure, the PRI3 
to PRI1 fields are shown as PRIx, and the bit positions 
in the fields are shown in brackets "[ ]'. V indicates a 
logical processor number (or thread number): 

As can be seen from the figure, PRIx[1 :0] indicates 
thr e priority levels: the lowest, the middle, and the high- 
est. The three priority levels are indicated by two bits, 
so that PRIx[1] can be set for supervisor mode, while 
PRIx[0] can be set for user mode. The setting of priority 
is conducted by the functional unit B in accordance with 
a special instruction (in mnemonic code) described in 
the following. 

"inc pri B : this instruction raises the priority, that is, 
PRIx[1] is 1 in the supervisor mode, while PRIxfO] is set 
to 1 in the user mode. 

"dec pri": this instruction lowers the priority, that, is, 
PRIx[1] is set to 0 in the supervisor mode, while PRIxfO] 
is 0 in the user mode. 

Unlike data transfer instructions between general 
registers, the above instructions consist of operation 
codes without operands, so that the same instruction 
can be used in any instruction stream. For instance, they 
are useful in the case where multiple instruction streams 
are generated from one program and processed in par- 
allel, with different data being assigned to each instruc- 
tion stream. 

Since the priority level of the instruction stream to s 
which the instruction belongs is changed by one func- 
tional unit, other instruction streams are not inadvertent- 
ly r written. Thus : malfunction can be prevented. For in- 
stance, when performing the same image processing on 
RGB color image data, that is, when executing one im- 
ag processing program as thr instruction streams si- 
multaneously and independently of each other, informa- 
tion can be opacified (there is no need to distinguish be- 
tween the programs for R, G, and B), and the independ- 
ence of each instruction stream can be guaranteed. As 



a result, the reliability of the OS and the overall system 
can be improved. 

By using these instructions and bit allocation shown 
in the figure, even if the priority is changed along with a 
5 mode change from the user mode to the supervisor 
mode, the original priority will be retained when it returns 
to the user mode. For instance, even if it temporarily en- 
ters the supervisor mode due to interrupt occurrence in 
the user mode, the priority in the user mode will be re- 
10 tained by resetting PRIx(1] to the original value before 
returning from the interrupt process to the user mode. 

FIG. 5 shows each higher 1-bit allocation of the 
PRI3 to PRI1 fields in the PRI register showing the pri-. 
ority. 

is As can be seen from the figure, PRIx[2] indicates 
whether the logical processor is in an execution state of 
in a halt state. The setting of status change from an ex- 
ecution state to a halt state is conducted by the func- 
tional unit B in accordance with a special instruction (in 

20 mnemonic code) shown in the following. 

"halt": this instruction put the issuer logical proces- 
sor in a halt state, that is, PRIx[2] of the logical processor 
is set to 1 . The halt state caused by this instruction is 
called a self -halt state to distinguish from halt states by 

25 other instructions. 

Return from a self-halt state to an execution state 
is conducted by interrupt input to the logical processor, 
instead of an instruction. Since interrupts occur to the 
logical processors independently of each other in a mul- 

30 tithreaded processor, a self-halt state is cancelled when 
an interrupt (an external or internal interrupt) occurs to 
a logical processor in the self-halt state. 

[Priority Control Unit 60: internal Interrupt Register] 

35 

FIG. 6 shows the bit configuration of the internal in- 
terrupt register (hereinafter referred to as "IR register") 
contained in the priority control unit 60. The "internal in- 
terrupt" refers to an interrupt between logical proces- 
40 sors, that is, an interrupt from one logical processor to 
another. An internal interrupt can be used for processing 
instructions in synchronization with logical processors 
or communicating in synchronization with logical proc- 
essors, because the self-halt state of one logical proe- 
ms essor is cancelled by another logical processor. 

As shown in FIG. 6, the IR register includes a MYID 
field and IR3 to IR1 bits, and makes an internal interrupt 
request to another logical processor. 

The MYID field is the same as the MYID field shown 
so in FIG. 5, and therefore, an explanation of it is not pro- 
vided here. . 

The IR3 bit indicates that a processor makes an in- 
ternal interrupt request to the logical processor 3. When 
this bit is "ON", PR3[2] is reset to 0 while IR3 is return d 
55 to "OFF" under the control of the instruction decode unit 
3, which has received the interrupt request. Here, the 
self-halt state of the logical processor 3 is cancelled by 
resetting PR3[2] to 0. 
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The 1R2 and IR1 bits are interrupt request bits for 
the logical processors 2 and 1 , respectively and they 
are th same as the IR3 bit. 

The setting of the IR3 to IR1 bits are conducted in 
accordance with a conventional registertransfer instruc- 
tion. With the conventional register transfer instruction, 
it is necessary to write into the positions of IRS to IR1, 
and therefore, each instruction stream need to distin- 
guish itsown logical processor ID from the interrupt des- 
tination logical processor ID. By reading out the above 
MYID field, each instruction stream can identify its log- 
ical processor ID. 

[Priority Control Unit 60: Exclusive Halt Register] 

FIG. 7 shows the bit configuration of the exclusive 
halt register (hereinafter referred to as "EXCL register") 
contained in the priority control unit 60. Here, "exclusive 
halt" refers to a halt of a processor other than a prede- 
termined processor. It should be noted that two or more 
logical processors cannot be in an exclusive halt state 
at the same time. 

As shown in FIG. 7, the EXCL register has a MYID 
field and EXCL3 to EXCL1 bits, and orders that one log- 
ical processor be put in an execution state, and the re- 
maining logical processors be put in a halt state. 

The MYID field is the same as in FIG. 3 and FIG. 6, 
and therefore, it is not described below. 

If the EXCL3 bit is ■ONI", the logical processor 3 is 
in an exclusive halt state. In such a case, only the logical 
processor 3 can operate, and the logical processors 2 
and 1 will be in a halt state. 

The EXCL2 and EXCL1 bits are the same as the 
EXCL3 bit. 

The setting and resetting of the EXCL3 to EXCL1 
bits are conducted by the functional unit B in accordance 
with a special instruction (in mnemonic code) described 
in the following. 

"excsv 0 : this instruction sets an exclusive halt to the 
issuer logical processor, that is, halts the logical proc- 
essors except for the issuer logical processor. For in- 
stance, if the logical processor 1 executes this instruc- 
tion, EXCL1 is "ON", while EXCL2 and EXCL3 are set 
to "OFF". Even if a plurality of logical processors issue 
this instruction at the same time, not all the processors 
will stop their operations, because this instruction is ex- 
ecuted only for the functional unit B. 

"retex": this instruction cancels an exclusive halt of 
the issuer logical processor, that is, it returns the remain- 
ing logical processors into the original state. For in- 
stance, if the logical processor 1 executes this instruc- 
tion, EXCL1 is set to "OFF". 

These instructions can be used as the incpr instruc- 
tion and the decpr instruction in any instruction stream : 
without operands. 

Th three control r gist rs, the PR I register the IR 
register, and the EXCL register, are separate entities, 
but the MYID field of each register and the MYPRI field 



of the PRI regist r indicate the value of the logical proc- 
essor itself. This is the reason that each logical proces- 
sor appears to have a different regist r. Furthermore, 
since the addressing of these control registers is the 
s same in all the logical processors, it is possible to obtain 
the ID and priority of each logical processor even when 
the same instruction is executed. 

[Instruction issue Deciding Unit 30] 

10 

FIG. 8 is a block diagram showing a detailed struc- 
ture of the instruction issue deciding unit 30 of FIG, 2. 
This instruction issue deciding unit 30 comprises a halt 
deciding unit 310, a demultiplexer unit 320, and an issue 

is deciding unit 330. 

The halt deciding unit 310 includes three pairs of 
NOR circuits and AND circuits corresponding to the in- 
struction decode units 1 to 3. Upon receipt of the above- 
mentioned instruction issue request (consisting of a re- 

20 quest flag and a functional unit number) from the instruc- 
tion decode units, each pair of a NOR circuit and an AND 
circuit forcibly turns the signal of the request flag (here- 
inafter referred to as "request existence signal") off in 
the case where each logical processor is in a self-halt 

25 state (where PRix[2] of the PRI register is on) or in an 
exclusive halt state (where the EXCLx bit is on), and it 
outputs the request existence signal as it is, in the case 
where each processor is in an execution state and not 
in an exclusive halt state. 

30 The demultiplexer unit 320 includes three demulti- 
plexers corresponding to the respective instruction de- 
code units 1 to 3. In accordance with the functional unit 
number, each demultiplexer disperses a request exist- 
ence signal, inputted via the halt deciding unit 310, to 

35 the functional unit to execute the instruction. As a result, 
each instruction decode unit outputs a request exist- 
ence signal to each functional unit. 

The issue deciding unit 330 includes four sets of 
AND circuits corresponding to the respective functional 

40 units A to D. Each set of AND circuits output a request 
existence signal dispersed by the demultiplexer unit 320 
as it is, in the case where the corresponding functional 
unit is in a ready state as described above, while each 
set of AND circuits turn the request existence signal off 

45 before output in the case where the corresponding func- 
tional unit is not in a ready state. A ready_n signal {n is 
A, B, C, or D) indicates that the corresponding functional 
unit is in a ready state. It is a 3-bit signal outputted from 
the functional unit x corresponding to the logical proc- 

so essors 1 to 3. Output signals (1 A to 3A, 1 B to 3B, 1 C to 
3C, and 1 D to 3D) from the issue deciding unit 330 are 
all effective (that is, instruction issuance is possible) 
when the logical value is "1". For instance, the output 
signal 1 A indicates that the instruction issuer is the in- 

ss struction decode unit 1 and the destination is the func- 
tional unit A, while the output signal 3B indicates that 
the instruction issuer is the instruction decode unit 3 and 
the destination is the functional unit B. 
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[Instruction Issue Arbitration Unit 40] 

FIG. 9 is a block diagram showing a detailed struc- 
ture of the instruction issue arbitration unit 40 of FIG. 2. 
The instruction issue arbitration unit 40 comprises arbi- 
tration units 40A to 40D corresponding to the respective 
functional units A to D. As each arbitration unit operates 
in the same manner, the following description concerns 
only the arbitration unit 40A, which includes a priority 
judging unit 41 A and a judgement auxiliary unit 42A. 

The priority judging unit 41 A receives the signals 
1 A, 2A, and 3A outputted from the issue deciding unit 
330, and the priority (PRI1[1 :0], PRI2[1:0], PRI3[1:0]>6f 
each logical processor. The priority judging unit 41 A 
then outputs the request existence signal having the 
highest priority. The control logic to perform this process 
with the priority judging unit 41 A are shown in FIGs. 1 0A 
to 10C. . 

FIG. 10A shows input 1 A, 2A, and 3A, and output 
1A* 2A' and 3A' in the case where the priority of the 
lu^icrtlpiocessbrs 1 to 3 designated by the PRI1, PRI2, 
nnd PRI3 fields in the PRI register is shown as PRI1 > 
Pni2 >PRl3 that is, where PR1 1 has the highest priority 
.md PRI3 has the lowest priority. Though not shown in 
ih- hpurc if PR1 > PRI3> PRI2, PRI2 > PRI1 > PRI3, 
PRl2 > PRI3 > PRI1, PRI3 > PRI1 > PRI2, or PRI3 > 
PRI2 >-pRll the same control logic as above can be 
obinined by reading the signals by different names. 

FIG 10B shows the case where PRI1 "= PRI2 > 
PRI3 ih*Ns where (PR1 1 ; PRI 2, PRI 3)= (highest, high- 
esi middle), (highest, highest, lowest), or (middle, mid- 
dle lowestv Though not shown in the figure, if PRI1 = 
PRI3 > PRI2. PRI2 = PRI1 > PRI3, PRI2 = PRI3 > PRI1 , 
PRI3 PRI1 > PRI2 ( or PRI3= PRI2 > PR1 1, the same 
conuol logic as above can be obtained by reading the 
siqnnls by different names. If there are two or more ef- 
fective signals having the highest priority among input 
signals as the output signals marked by wavy lines in 
the h^ure. the priority judging unit 41 A outputs them as 
•r 

FIG. 10C shows the case where PRI1 > PRI2 = 
PRI3 that is, where (PRI1, PRI2, PRI3) = (highest, mid- 
dle middle), (highest, lowest, lowest), or (middle, low- 
csi lowest). Though not shown in the figure, if PRI1 > 
PHI3 ■ PRI2. PRI2 > PR1 1 = PRI3, PRI2 > PRI3 = PR1 1 , 
PRI3> PRIi = PRI2, or PRI3> PRI2 = PR1 1, the same 
control logic as above can be obtained by reading the 
signals by different names. 

The priority judging unit 41 A outputs all effective 
signals as '1 n in the case where PRI1 = PRI2 = PRI3, 
lhal is. there are two or more effective input signals. 

If two or more logical processors having the same 
priority in the PRI register issue an instruction issue re- 
quest at the same time, that is, if two or more outputs of 
the priority judging unit 41 A (1A\ 2A\ and 3A') are "1", 
the judgement auxiliary unit 42A determines which one 
of the outputs (1 A', 2A\ and 3A') of the priority judging 
unit 41 A should be " 1 " so as to allow the logical proc s- 



sors instruction issuance fairly. For instance", the judge- 
ment auxiliary unit 42A: (1) selects a different logical 
processor to be B 1 " every one cycle or very few cycles; 
(2) gives priority to logical processors which have not 
5 issued an instructbn; and (3) definitely determines 
which logical processor should be "1\ The judgement 
auxiliary unit 42A may switch the operation manner 
among (1), (2), and (3), 

10 [Instruction Issue Prohibition Unit 50] 

FIG. 11 is a block diagram showing the detailed 
structure of the instruction issue prohibition unit 50. This, 
instruction issue prohibition unit 50 comprises prohibi- 
ts tion units 50A to 50D corresponding to the respective 
functional units A to D, and an issue notification unit 55. 
Since all the prohibition units operate in the same man- 
ner, the following description concerns only the prohibi- 
tion unit 50A. 

20 The prohibition unit 50 A includes a prohibition con- 
trol unit 51 A lor detecting the ID of a logical processor 
which has urgently issued an external interrupt request, 
an internal interrupt request, an access exception such 
as a cache miss and memory access error, and a trap 

25 instruction, and for controlling so as to prohibit instruc- 
tion issuance to the issuer logical processor during one 
cycle, three AND circuits for outputting to the instruction 
selecting unit 70 instruction issue commands 1 AAA to 
3AAA obtained by gating output signals 1AA to 3AA 

30 from the arbitration unit 40 A in accordance with instruc- 
tions from the prohibition control unit 51 A, and an OR 
circuit for notifying the functional unit A of the instruction 
issuance. . 

The issue notification unit 55 comprises three, OR - 
35 circuits corresponding to the respective instruction de- .: 
code units 1 to 3. Every time an instruction issue com- 
mand is outputted from the prohibition units 51 A to 51 D 
to each logical processor, the issue notification unit 55 
outputs an issue notification for notifying the corre- 
40 sponding instruction decoding unit that the next instruc- 
tion can be issued. 

[Functional Unit B] 

45 The functional unit B executes not only integer arith- 
metic instructions but also the above-mentioned special 
instructions and read instructions for reading the PRj 
register, the EXCL register, and the IR register. 

The special instructions are executed by the func- 

50 tional unit B in this embodiment, but they may be exe- 
cuted by another functional unit. 

FIG. 1 2 shows the processing of the special instruc- 
tions and th read instructions performed by the func- 
tional unit B. In this figure, V indicat s th number of a 

55 logical processor which has issu d the instruction, while 
V indicates th ID of each logical processor other than 
the issuer logical processor; The functional unit B is no- 
tified of the logical processor number from the signal 
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(1BBB to 3BBB shown in FIG. 11) outputted from the 
prohibition unit 50B. 

As shown in the figure, according to an "inc pri* in- 
struction, the functional unit B sets the PRIx[1] bit of the 
PRI register to "1 B in the supervisor mode, and the PRIx s 
[0] bit to "1 ■ in the user mode. 

According to a "dec pri" instruction, the functional 
unit B sets the PRIx[1 ] bit to "0" in the supervisor mode, 
and the PRJx[0] bit to "0" in the user mode. 

According to a "halt" instruction, the functional unit 10 
B sets the PRIx[2] bit of the PRI register of the logical 
processor to "1 

According to an "excsv" instruction, the functional 
unit B sets the EXCLx bit of the EXCL register to "1 V 
and the EXCL bit to "0". For instance, if the logical proc- 1$ 
essor 2 is the issuer of the instruction, the functional unit 
B sets the EXCL2 bit to "1", and the EXCL3 bit and 
EXCL1 bits to "0*. 

According to a "retex" instruction, the functional unit 
B sets the EXCLx bit to "0". 20 

Even if the same special instruction is to be execut- 
ed, different bits in the register are used in accordance 
with the issuer logical processor 

The functional unit B executes each "mov" instruc- 
tion shown in FIG. 1 2 as follows. 2S 

A "mov PRI.R0" instruction is issued to transfer the 
content of the PRI register to the R0 register. The func- 
tional unit B executes this instruction as follows. 

In the MYID field (= PRI[31 :2g]) of the PRI register, 
the ID of the logical processor which has issued the in- 30 
struction is written into each bit of R0[31 :29]. 

PRI[11 :3] (= PRI3, PRI2, and PRI1 fields) in the PRI 
register is read out and transferred to [11:3] in the R0 
register. 

As for PRI[2:0] (= MYPRI field), a PRIx selected 35 
from the PRI3, PRI2, and PRI1 fields corresponding to 
the ID of the logical processor which has issued the in- 
struction is written into each bit of R0[31 :29]. 

A "mov IR, TO" instruction is issued to transfer the 
content of the IR register to the R0 register. According 40 
to this instruction, the functional unit B writes the ID of 
the logical processor which has issued the instruction 
into each bit of R0[31 :29] in the MYID field (= IR[31 :29]) 
of the IR register. The value of each bit of IR{2:0] (= IRS, 
IR2, and IRT bits) is read out and written into each bit *s 
of R0[2:0). 

A "mov EXCL.R0" instruction is issued to transfer 
the content of the EXCL register to the R0 register. The 
processing of the instruction performed by the functional 
unit B are the same as of the "mov IR.R0" instruction, so 
except that the transfer destination is the IR register. 

By performing the above read instructions, each 
logical processor can obtain the value of the logical 
processor ID from the read MYID field and th status 
(priority, self-halt stat , exclusive haft state, or the like) ss 
of other logical processors. 



[Detailed Structure of the Priority Control Unit 60] 

FIG. 13 is a block diagram showing the structure of 
the priority control unit 60 in detail. 

The priority control unit 60 comprises a PRI register 
61 , an IR register 62, an EXCL register 63, a selector 
64, and a continuous cycle prioritizing unit 69. 

As the bit configurations of the PRI register 61 , the 
IR register 62, and the EXCL register 63 have already 
been explained with reference to FIGs. 3, 6, and 7, the 
following description concerns only the hardware struc- 
ture. 

The registers 61 to 63 are connected to the internal 
bus of the multithreaded processor, and read and write 
in the functional unit B are performed via the internal 
bus. 

The higher three bits (MYID field) of these registers 
61 to 63 holds no data. Instead, they output the logical 
processor ID to the internal bus transparently when ex- 
ecuting a read instruction. The value of the logical proc- 
essor ID is notified by way of the signals (1 BBB to 3BBB 
in FIG 11) outputted from the prohibition unit 50B. 

When the PRI register 61 executes a read instruc- 
tion, the lower three bits of the PRI register 62 output 
the output of the selector 64 to the internal bus trans- 
parently. 

The selector 64 selects one field corresponding to 
the issue logical processor ID from the PRI3 : PRI2, and 
PRI1 fields in the PRI register 61 , and outputs it to the 
internal bus via the MYPRI field in the IR register 62 at 
the time of the execution of a read instruction by the PRI 
register 61. 

The continuous cycle prioritizing unit 69 can tempo- 
rarily raise the priority level during a special instruction 
stream is executed. The special instruction stream 
needs to be executed in continuous cycles, when read- 
ing and writing a resource shared by other logical proc- 
essors, for instance. 

An example special instruction stream is shown be- 
low. It should be noted that the instructions are written 
in mnemonic code. Remarks as to each instruction is 
provided after LOOP: 

; label 

aldst MEM[100], R0 

; also known as "Atomic LoaD STart instruction" 
; transfer the data of the memory (address 1 00) to 
R0 lest R0 

; if R0 = 0, set the zero flag to "1 " beq LOOP 

; if the zero flag is 1 , branch to the label LOOP store 

R1, MEM[100] 

; transfer the data of the register R1 to the memory 
address 100 

The above special instruction stream reads out the 
memory address 100, and if the r ad data is "0", it writes 
the data of the register R1 into the memory address 1 00. 
If the read data is not "0", the special instruction stream 
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orders a loop process for reading repeatedly until It 
reads out data "0\ The special instruction stream needs 
to be executed in continuous cycles, for instance, when 
the memory address 100 is used as a shared resource 
by a plurality of logical processors. That is, during the s 
execution of the special instruction stream by on logical 
processor, other logical processors are not allowed to 
rewrite the memory address 100. 

If one functional unit has detected the execution 
start of the first instruction of the special instruction 
stream, to make sure that the special instruction stream 
is executed in continuous cycles, the continuous cycle 
prioritizing unit 69 temporarily changes the priority of the 
priority control unit 60 so that the priority level of the in- 
struction issuer logical processor (or instruction stream) 
will be higher than other logical processors during a pre- 
determined number of continuous cycles that continues 
from the execution cycle of the instruction. 

[Continuous Cycle Prioritizing Unit 69] 

The continuous cycle prioritizing unit 69 comprises 
a special instruction detecting unit 65, a counter 66, a 
comparator 67, and a selector 68. 

In this figure, the special instruction detecting unit 
65 detects the execution start of the first instruction of a 
special instruction stream (hereinafter referred to as 
"the special instruction"). In the above example special 
instruction stream, the aldst instruction is determined as 
the sp cial instruction. More specifically, the special in- 
struction detecting unit 65 detects the execution start of 
the special instruction upon receipt of the notification 
that the instruction decode units 1 to 3 have decoded 
the special instruction, and another notification that the 
instruction issue prohibition unit 50 has issued the spe- 
cial instruction to one of the functional units. 

The counter 66 counts the number of cycles re- 
quired for the execution of the special instruction stream 
after the execution start of the special instruction has 
been detected. In the example special instruction 
stream, three cycles required for the execution of three 
instructions following the aldst instruction, and there- 
fore, the counter 66 is loaded with an initial value "3" 
when the execution start is detected, and then decre- 
mented to "0". By doing so, the counter will be "0" in the 
execution cycle of the store R1 , MEM[100] instruction. 
If the special instruction stream requires a loop process, 
the counter 66 is incremented by one from the initial val- 
ue "3" every time the aldst instruction is detected. 

The comparator 67 judges whether the count value 
of the counter 66 is "0", that is, whether the special in- 
struction stream should be executed in continuous cy- 
cles. 

The selector 68 is a 6-bit long, 4-input and 1 -output 
sel ctor and used for temporarily changing the priority 
during the continuous cycles. 

FIG. 14 shows the select signals inputted into the 
selector 68, and the relationship between the select sig- 



nals and output values. Although the input valu s of the 
selector 68 are not shown in this table, they are B PRI[1 1 : 
3] (= PRI3[1:0], PR12[1:0), PRI1[1:0])". •110000". 
"001100", and "000011", as can be seen from FIG. 1 3. 

Normally, i.e., when not in a continuous cycle peri- 
od, the selector 68 outputs the priority level designated 
in PRI[11:3] (= PRI3, PRI2, and PRI1 fields) of the PRI 
register as shown in FIG. 14. 

When in a continuous cycle period (i.e., when the 
count value is 0), the selector 68 outputs the value of 
"PRI[11:3] (= PRI3'(1:0], PRI2'[1:0], PRir[1:0))", which 
is "110000" if the instruction issuer is the logical proces- 
sor 3, "001100" if the instruction issuer is the logical 
processor 2, and "000011 " if the instruction issuer is the 
logical processor 1 . 

Thus, the priority of the logical processor which has 
issued the special instruction is temporarily changed to 
the highest during the continuous cycle period. 

The following description concerns the operation of 
the multithreaded processor of this embodiment having 
the structure described above. 

[Operation in Setting Priority, Self-halt State, and 
Exclusive Halt State] 

The multithreaded processor of this embodiment is 
provided with special instructions including an "incpr" in- 
struction and a "decpr" instruction for setting.and chang- 
ing the priority level of each instruction stream (each log- 
ical processor), a "halt" instruction for self -halt, and an 
"excsv" instruction and a "ret ex" instruction for exclusive 
haft. These instructions need to be predetermined in the 
program that generates the instruction streams. 

When a priority level in the program should be 
raised, for instance, the "incpr" instruction should be is- 
sued immediately before the program, while the "decpr" 
instruction should be issued immediately after the pro- 
gram. The "incpr" and "decpr" instructions set as above 
are executed by the functional unit B as follows. De- 
pending on which one of the logical processors 1 to 3 
has issued the instruction, the functional unit B sets the 
PRIx[0] bit in the. corresponding PRx field of the PFll reg- 
ister to "1 " or "0" in the user mode, while it sets the PRIx 
[1] bit to "1" or "0' in the supervisor mode. By doing so, 
the priority level of each logical processor can be flexibly 
changed. 

When operating only the present logical processor 
and halting the remaining logical processors in the pro- 
gram, the "excsv" instruction should be provided imme- 
diately before the corresponding part of the program, 
while the "retex" instruction should be provided imme- 
diately after the corresponding part of the program. 
These instructions ar xecuted by the functional unit B 
as in the same manner as above. 

On th other hand, when halting th present logical 
processor and giving priority to the remaining logical 
processors, the "halt" instruction should be provided. 
This instruction is also executed by the functional unit 
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6. An interrupt request should be suitably inputted into 
a logical processor in a halt state, because the halt state 
of the logical processor can be cancelled by an interrupt 
request. For instance, an internal interrupt between the 
logical processors is conducted by the IR register. An $ 
interrupting logical processor reads out the MYID in ad- 
vance from the IR register, the PRl register, or the EXCL 
register, according to a normal register transfer instruc- 
tion. The logical processor then determines the IRx bit 
corresponding to the logical processor to be interrupted, 10 
and sets an internal interrupt request in the IR register 
according to a normal transfer instruction. 

[Overall Operation) 

is 

In the case where the logical processor 1 is in a self- 
halt state or in a halt state due to an exclusive halt of 
another logical processor if an instruction issue request 
(a request flag and the number of the functional unit B) 
is oulpuiled to the functional unit B according to the de- 20 
code lesuit of the instruction decode unit 1 , the stop de- 
ciding unit 310 in the instruction issue deciding unit 30 
nullities the request flag. Thus, the remaining logical 
processors 2 and 3 can use the functional units. 

in the case whore the logical processor 1 is neither 2S 
tn h coll -hart slate nor in a halt state due to an exclusive 
n^t! o! another logical processor, the instruction issue 
request is distributed to the functional unit B by the de- 
mutioinxer 320 in the instruction issue deciding unit 30. 
11 tho functional unit B is ready to receive an instruction so 
irom the logical processor 1 , the issue deciding unit 330 
judges tnal the instruction issue request can be issued, 
while if the functional unit B is not ready to receive an 
instruction, the issue deciding unit 330 judges that the 
instruction issue request cannot be issued. 

Upon receipt of an instruction issue request of each 
functional unit from the instruction issue deciding unit 
30 the instruction issue arbitration unit 40 determines 
which logical processor can issue an instruction to each 
functional unit, depending on the information as to the 40 
priority of each logical processor sent from the priority 
control unit 60. For instance, if an instruction issue re- 
quest is issued only from the instruction decode unit 1 
to the lunctional unit B (that is, if only IB is effective 
among i B to 3B in FIG. 9), the instruction issue arbitra- 45 
tion unit 40 makes only the issued instruction issue re- 
quest effective (only 1 BB is effective among 1 BB to 3BB 
in FIG 9). 

In the case where the instruction decode unit 1 de- 
codes an instruction for the functional unit A, the instruc- so 
tion decode unit 2 decodes an instruction for the func- 
tional unit B, the instruction decode unit 3 decodes an 
instruction for the functional unit C, and all the functional 
units are ready to receive an instruction, the instruction 
issue arbitration unit 40 makes all th thre instruction ss 
requests effective. 

In the case where the instruction issue decode unit 
1 decodes an instruction for the functional unit A, and 



the instruction decode unit 2 also decodes an instruction 
for the functional unit A (that is, where 1 A arid 2A are 
effective at the same time in FIG. 9), the priority judging 
unit 41 A judges the priority from the PRl register in th 
priority control unit 60, and issues the higher priority lev- 
el instruction first. If the priority levels of the logical proc- 
essors 1 and 2 are the same, the judgement auxiliary 
unit 42A makes one of the instruction issue request ef- 
fective. 

In the case where an instruction determined to be 
issued by the instruction issue arbitration unit 40 needs 
to be processed urgently by one of the logical proces- 
sors, the instruction issue prohibition unit 50 prohibits 
the logical processor from issuing an instruction. 

The instruction issue deciding unit 30 and the in- 
struction issue prohibition unit 50 each has the function 
of excluding an instruction issue request for the reasons 
described below. 

Instructions which can be judged not to be issuable 
at an early stage are excluded from issuable instructions 
by the instruction issue deciding unit 30. However, if in- 
structions judged not to be issuable only at a later stage 
are also excluded by the instruction issue deciding unit 
30, the final decision as to whether instruction issuance 
is possible will be delayed, and the frequency of the 
processor will be adversely affected. 

For instance, if a decision to issue an instruction to 
the instruction issue prohibition unit is made in one cy- 
cle, the instruction should be excluded when the instruc- 
tion issue deciding unit 30 is informed at a later stage 
that the instruction cannot be issued. In such a case, the 
cycle needs to be long, which often impedes an increase 
in clock frequency. To avoid such a situation, the instruc- 
tion issue prohibition unit 50 is employed to prohibit isr 
suance of instructions which are judged not to be issu- 
able only at a later stage. If the logical processor as the 
instruction issue prohibition unit 50 is prohibited from is- 
suing instructions, the same prohibiting instruction can- 
not be issued from another logical processor, because 
at this stage, one instruction has already been selected 
for each of the functional units A to D. 

After that, the instruction selecting unit 70 sends in- 
struction contents and operations decoded by the in- 
struction decode units 1 to 3 to the functional units A to 
D according to instruction issue orders from the instruc- 
tion issue prohibition unit 50 (1 AAA to 3AAA, 1 BBB to 
3BBB, 1CCCto3CCC, and 1DDD to 3DDD in FIG. 11). 

Although the number of logical processors is 3 and 
the number of functional units is 4 in this embodiment, 
these numbers can be changed at will. 

The content of the PRl register may be held by a 
plurality of registers. For instance, each PRIx[2] bit for 
self-halt and each PRIx[1:0] field for indicating priority 
level may b included in separate registers. On th other 
hand, all or two regist rs among the PRl regist r, the IR 
register, and th EXCL register may be included in one 
register. 

The special instruction detecting unit 65 may detect 
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the execution start of the special instruction upon receipt 
of a notification from th functional unit that has started 
the execution of the special instruction. 

Although the present invention is applied to compe- 
tition among a plurality of logical processors for the func- 
tional units in this embodiment, it may also be applied 
to a resource shared by a plurality of logical processors. 
The following is an explanation of such a case as an- 
other embodiment. 

[Another Embodiment] 

The priority levels of a plurality of logical processors 
can be used for arbitration among the logical processors 
accessing a shared resource, and an example of such 
a case is described below. 

FIG. 15 is a block diagram showing the structure of 
the multithreaded. processor of another embodiment of 
the present invention. 

This multithreaded processor comprises a cache 
memory 100, instruction decode units 111 to 113, regis- 
ters 131 to 133, an instruction fetch control unit 140, an 
instruction issue control unit 150, a priority control unit 
60. functional units A20 to D23, and a register control 
unit 170. The components having the same numbers as 
in FIG. 2 are the same in the first embodiment, and 
therefore, the following description mainly concerns dif- 
lerent aspects. 

In FIG. 1 5. the cache memory 1 00 is used for a pro- 
gram which generates instruction streams. 

The instruction decode units 111 to 113 are the 
same as the instruction decode units 1 to 3 shown in 
FIG 2. except that they are controlled by the instruction 
letch control unit 140. 

The registers 1 31 to 1 33 are register files each con- 
sisting of a plurality of registers corresponding to the in- 
struction decode, units 111 to 113, respectively. Thus, 
they also correspond to the logical processors 1 to 3. 

The instruction fetch control unit 140 has the same 
functions as the instruction issue arbitration unit 40 and 
the instruction issue prohibition unit 50 shown in FIG. 2, 
except that the competition among instruction fetch re- 
quests, instead of instruction issue requests, is arbitrat- 
ed. In the case where the fetching order is determined 
according to the priority, or where the operation of a pre- 
determined logical processor is stopped when the prior- 
ity designation of each logical processor is inputted from 
the priority control unit 60, and a plurality of instruction 
decode units simultaneously issue instruction fetch re- 
quests to the cache memory 100, instruction fetching 
from the instruction decode unit of the predetermined 
logical processor will be stopped. 

The instruction issue control unit 150 has the same 
function as the combined functions of th instruction is- 
sue deciding unit 30, the instruction issue arbitration unit 
40, the instruction issue prohibition unit 50, and the in- 
struction selecting unit 70, and therefore, no xplanation 
of it is not provided here. 



The r gister control unit 170 has the same function 
as the combined functions of the instruction issue de- 
ciding unit 30 and the instruction issue arbitration unit 
40, except that the competition among register access 

s requests, instead of instruction issue requests, is arbi- 
trated. In the case where the priority designation of each 
logical processor is inputted from the priority control unit 
60, and a plurality of functional units simultaneously out- 
put requests tor data write, the register control unit 170 

io determines the write order in accordance with the prior- 
ity level. 

With the above structure, not only the competition 
among the logical processors for one functional unit, but 
also the competition among instruction fetch requests 

is for the cache memory and the competition among data 
access requests for one register group can be arbitrated 
or stopped in accordance with the priority level. 

Although the number of instruction streams and log- 
ical processor and the number of functional units are 4 

20 in the above description, the numbers are not limited to 
4. 

The number of priority levels is 3 (2 bits) in the 
above description, but it is not limited to that. The control 
register is. 32-bit long, but it may be shorter or longer 

25 than that. 

If branches occur simultaneously in a plurality of 
logical processors which share the same resource or 
cache for address calculation, the competition among 
them can be arbitrated in accordance with the priority * 

30 level as in other embodiments. 

Although the P Rl registe r changes the priority levels 
according to special instructions, the hardware may also 
set and change priority levels. In such a case, depend- 
ing on the timing in setting of the priority level of each 

35 instruction stream and the state of each instruction 
stream under supervision, a change in the priority is trig- 
gered by external or internal factors of the hardware. 

In the above embodiment, two or three instructions 
having the same priority level are made all effective and 

40 outputted from the priority judging unit 41 A as shown in 
FIG. 9, but only one instruction may be made effective 
and outputted. In such a case, the judgement auxiliary 
unit 42A is not necessary. 

Although the judgement auxiliary unit 42A is provid- 

45 ed after the priority judging unit 41 A in FIG. 9, it may be 
disposed between the priority control unit 60 and the pri- 
ority judging unit 41 A so that the priority can be flexibly 
changed when two or more instruction streams have the 
same priority level. 

50 In the above embodiment, the MYPRI field in the 
PRI register outputs the priority level of the issuer of a 
read instruction for the PRI register. Likewise, aMYDA- 
TA filed may be provided for outputting the data of each 
logical processor (status data, rror information, and the 

55 lik ). 

An urgent process det ct d by th prohibition unit 
50A may be an event or an exceptional process. The 
event may be an external interrupt or an internal inter- 
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rupt. The exceptional process may be a cache miss, an 
access exception such as a memory access error, a trap 
instruction, an arithmetic exception, or an arithmetic er- 
ror. 

In the above embodiments, each instruction decode s 
unit decodes one instruction, and one instruction is is- 
sued at a time. However, an instruction decode unit may 
decode a plurality of instructions in one instruction 
stream, and also issue a plurality of instructions. 

Although the present invention has been fully de- io 
scribed by way of examples with reference to the ac- 
companying drawings, it is to be noted that various 
changes and modifications will be apparent to those 
skilled in the art. Therefore, unless otherwise such 
changes and modifications depart from the scope of the is. 
present invention, they should be construed as being 
included therein. 



Claims 20 

1 . A multithreaded processor for executing multiple in- 
struction streams, comprising: 

a plurality of functional units for respectively ex- 2s 
ecuting an instruction; 

a plurality of instruction decode means, corre- 
sponding to the multiple instruction streams on 
a one-to-one basis, for respectively decoding 
an instruction, and producing an instruction is- so 
sue request for designating to which functional 
unit the decoded instruction should be issued 
and requesting for the issuance of the decoded 
instruction to the designated functional unit; 
holding means for holding priority level of each 35 
of the instruction streams; and 
control means for deciding which decoded in- 
struction should be issued to a functional unit 
designated by two or more instruction issue re- 
quests at the same time, in accordance with the 40 
priority levels stored by the holding means. 

2. A multithreaded processor according to Claim 1, 
wherein 

45 

the holding means further has flags which can 
be set by an instruction for indicating whether 
each instruction stream should be halted or ex- 
ecuted, and 

the control means includes: $0 
arbitration means for making the decision; and 
stop means for stopping an instruction stream 
corresponding to a flag indicating a halt by ex- 
cluding the instruction issue requests of the in- 
struction streams corresponding to the flags in ss 
making the decision. 

3. A multithreaded processor according to Claim 2, 



wherein 

the control means further includes: 
prohibition means for temporarily prohibiting is- 
suance of the instruction decided to be issued 
by the control means to the functional unit, if 
there is a process which needs to be performed 
urgently in an instruction stream to which the 
instruction belongs. 

4. A multithreaded processor according to Claim 3, 
wherein 

the process to be performed urgently is an in- 
terrupt request or a cache miss occurrence notifica- 
tion. 

5. A multithreaded processor according to Claim 1, 
wherein 

one of the functional units receives a special 
instruction for ordering to change the priority level 
of an instruction stream to which the special instruc- 
tion belongs, the priority level being one of the pri- 
ority levels held by the holding means. 

6. A multithreaded processor according to Claim 5, 
wherein 

the special instruction is made up of only an op- 
eration code for indicating whether the priority 
levels should be raised or lowered, and 
one of the functional units detects which in- 
struction decode means has issued the special 
instruction in the case where a decode result of 
the special instruction is issued, and then rais- 
es or lowers the priority level of an instruction 
stream corresponding to the detected instruc- 
tion decode means. 

7. A multithreaded processor according to Claim 6, 
wherein 

the holding means includes a control register 
which has a first field for read only, and 
one of the functional units detects which in- 
struction decode means has issued a read in- 
struction when the decode result of the read in- 
struction of the control register is issued, and 
outputs the ID of the instruction stream corre- 
sponding to the detected instruction decode 
stream as the read data of the first field to an 
internal bus. 

8. A multithreaded processor according to Claim 7, 
wherein 

the control register includes priority fields for 
holding the priority level of each of the instruc- 
tion streams, and 
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one of the functional units reads out each of the 
priority fields when the decode result of the 
read instruction of the control register is issued. 

9. A multithreaded processor according to Claim 6, 
wherein 

the holding means has a control register, 
the control register includes individual fields 
corresponding to the multiple instruction 
streams on a one-to-one basis for holding in- 
herent data of the multiple instruction streams, 
and a second field for read only, and 
one of the functional units reads out the individ- 
ual field of each of the multiple instruction 
streams upon execution of a read instruction of 
the control register, and outputs the inherent 
data of the instruction stream corresponding to 
the instruction decode means that has issued 
the read instruction as the read data of the sec- 
ond field to the internal bus. 

10. A multithreaded processor according to Claim 9, 
wherein 

the inherent data of the multiple instruction 
streams show priority levels. 

11. A multithreaded processor according to Claim 6, 
wherein 

the holding means includes priority fields for 
holding the priority level of each instruction 
stream, 

the priority field of each instruction stream is 
made up of minor fields indicating the priority 
level of each instruction stream in each execu- 
tion mode, 

one of the functional units detects which in- 
struction decode means has issued the special 
instruction in the case where the decode result 
of the special instruction is issued, and then 
raises or lowers the priority level of each minor 
field for the current execution mode among the 
priority fields of the instruction stream corre- 
sponding to the detected instruction decode 
means. 

12. A multithreaded processor according to Claim 1, 
further comprising: 

specified instruction detecting means for de : 
tecting that one of the functional units has start- 
ed executing a specified instruction, and which 
instruction d code means has issued th de- 
code result of the specified instruction; and 
temporary modification means for temporarily 
modifying, if the specified instruction detecting 
means has detected the execution start of a 



specified instruction, th priority lev I of. the in- 
struction stream corresponding to the instruc- 
tion decode means which has issued the spec- 
ified instruction over a predetermined period of 
5 time, the priority level being modified so as to 

be higher than the priority levels of other in- 
struction streams. 

13. A multithreaded processor for executing multiple in- 
10 struction streams, comprising: 

a plurality of functional units for executing in- 
structions; 

a plurality of instruction decode means, corre- 
15 sponding to the multiple instruction streams on 

a one-to-one basis, for respectively decoding 
an instruction, and producing an instruction is- 
sue request for designating to which functional 
unit the decoded instruction should be issued 
20 and requesting the functional unit to issue the 

decoded instruction to the designated function- 
al unit; 

priority holding means for holding the priority 
level of each instruction stream; 
25 self-halt data holding means for holding self- 

halt data indicating whether to put each instruc- 
tion stream into an execution state or a halt 
state; 

arbitration means for determining, upon receipt 
30 of instruction issue requests sent from the plu- 

rality of instruction decode means, which de- 
coded instruction should be issued to the func- 
tional unit designated by two or more instruction 
issue requests at the same time, in accordance 
35 . with the priority levels held by the priority hold- 

ing means; and 

stop means for stopping notifying the arbitra- 
tion means of an instruction issue request from 
the instruction decode means corresponding to 
40 the instruction stream kept in a halt state by the 

self-halt data, the instruction issue request be- 
ing one of instruction issue requests sent from 
the Plurality of instruction decode units to the 
arbitration unit. 

45 

14. A multithreaded processor according to Claim 13, 
further comprising 

exclusive halt data holding means for holding 
so exclusive halt data for each instruction stream, 

the exclusive halt data indicating that one in- 
struction stream should be in an execution 
state, and that the remaining instruction 
streams should be in a halt state, 
55 and wher in 

the stop means stops notifying the arbitration 
means of the issuance of an instruction issue 
request from the instruction decode means cor- 
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responding to instruction streams kept in a halt 
state by the exclusive halt data. 

15. A multithreaded processor according to Claim 13, 
wherein 

one of the functional units changes the priority 
levels when a decode result of a special instruction 
ordering to change the priority levels is issued. 

16. A multithreaded processor according to Claim 15, 
wherein 

the special instruction is made up of only an op- 
eration code for indicating whether the priority 
levels should be raised or lowered, and 
one of the functional units detects which in- 
struction decode means has issued the special 
instruction in the case where a decode result of 
the special instruction is issued, and then rais- 
es or lowers the priority level of an instruction 
stream corresponding to the detected instruc- 
tion decode means. 

17. A multithreaded processor according to Claim 16, 
wherein 

the holding means includes a control register 
which has a first field for read only, and 
one of the functional units detects which in- 
struction decode means has issued a read in- 
struction when the decode result of the read in- 
struction of the control register is issued, and 
outputs the ID of the instruction stream corre- 
sponding to the detected instruction decode 
stream as the read data of the first field to an 
internal bus. 

18. A multithreaded processor according to Claim 17, 
wherein 

the control register includes priority fields for 
holding the priority level of each of.the instruc- 
tion streams, and 

one of the functional units reads out each of the 
priority fields when the decode result of the 
read instruction of the control register is issued. 

19. A multithreaded processor according to Claim 16, 
wherein 

the holding means has a control register, 
the control register includes individual fields 
corresponding to the multiple instruction 
streams on a one-to-one basis for holding in- 
herent data of the multiple instruction streams, 
and a second field for read only, and 
one of the functional units reads out the individ- 
ual field of each of the multiple instruction 



str ams upon execution of a read instruction of 
the control register, and outputs the inherent 
data of the instruction stream corresponding to 
the instruction decode means that has issued 
5 the read instruction as the read data of the sec- 

ond field to the internal bus; 

20. A multithreaded processor according to Claim 1 9, 
wherein 

10 the inherent data of the multiple instruction 

streams show priority levels. 

21. A multithreaded processor according to Claim 16, 
wherein 

15 

the holding means includes priority fields for 
holding the priority level of each instruction 
stream, 

the priority field of each Instruction stream is 
20 made up of minor fields indicating the priority 

level of each instruction stream in each execu- 
tion mode, 

one of the functional units detects which in- 
struction decode means has issued the special 

25 instruction in the case where the decode result 

of the special instruction is issued, and then 
raises or lowers the priority level of each minor 
field for the current execution mode among the 
priority fields of the instruction stream corre- 

30 sponding to the detected instruction decode 

means. 

22. A multithreaded processor according to Claim 13, 
wherein 

specified instruction detecting means for de- 
tecting that one of the functional units has start- 
ed executing a specified instruction, and which 
instruction decode means has issued the de- 
code result of the specified instruction, and 
temporary modification means for temporarily 
modifying, if the specified instruction detecting 
means has detected the execution start of a 
specified instruction, the priority level of the in- 
struction stream corresponding to the instruc- 
tion decode means which has issued the spec- 
ified instruction over a predetermined period of 
time, the priority level being modified so as to 
be higher than the priority levels of other in- 
so struction streams. 

23. A multithreaded processor for executing multiple in- 
struction streams simultaneously and independent- 
ly of each other, comprising: 

ss 

a plurality of functional units for executing in- 
structions simultan ously and independently of 
each other; 
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a plurality of instruction decode means, corre- 
sponding to the multiple instruction streams on 
a one-to-one basis, for respectively fetching 
and decoding an instruction of each instruction 
stream, and specifying to which functional unit 5 
the instruction should be issued; 
priority designating means for designating the 
priority level of each of the multiple instruction 
stream; 

instruction issue judging means for judging io 
whether the decoded instruction can be issued 
to the specified functional unit, depending on 
whether the specified functional unit is ready to 
receive an instruction; and 

instruction issue arbitration means for arbitrat- is 
ing between two or more instructions to deter- 
mine one instruction to be issued to the func- 
tional unit specified by the two or more instruc- 
tion decode means, in accordance with the pri- 
ority levels designated by the priority designat- 20 
ing means. 



24. A multithreaded processor according to Claim 23, 
further comprising 

instruction issue prohibition means for tempo- 
rarily prohibiting issuance of the instruction decided 
to be issued by the control means to the functional 
unit, if there is a process which needs to be per- 
formed urgently in an instruction stream to which 
the instruction belongs. 

25. A multithreaded processor according to Claim 24, 
wherein 

the process to be performed urgently is an in- 
terrupt request or a cache miss occurrence notifica- 
tion. 

26. A multithreaded processor according to Claim 24, 
wherein 

the priority designating means includes a con- 
trol register for holding the priority level of each in- 
. struction stream, the priority level being able to be 
set by an instruction in each instruction stream. 

27. A multithreaded processor according to Claim 26, 
wherein 

one of the functional units changes the priority 
levels when a decode result of a special instruction 
ordering to change the priority levels is issued. 

28. A multithreaded processor according to Claim 27, 
wherein 

the instruction issue arbitration means deter- 
mines which instruction should be issued to a func- 
tional unit according a predetermined proc dure, 
the functional unit being able to be set by two or 
more instructions, and the instruction streams to 
which the instructions belong have the same priority 



level. 

29. A multithreaded processor according to Claim 28, 
wherein 

the instruction issue arbitration means in- 
cludes auxiliary judgement means for determining 
which instruction should be issued according to the 
predetermined procedure, in which a different in- 
struction stream is selected in cycles, an instruction 
of an instruction stream different from the previous 
one is selected, or an instruction of one of the in- 
. struction streams is invariably selected. 

30. A multithreaded processor according to Claim 26, 
wherein 

the control register includes a priority field for 
each instruction stream in each execution 
mode, and 

the instruction issue arbitration means arbi- 
trates with reference to priority fields corre- 
sponding to the execution modes for the multi- 
ple instruction streams. 

2S 31. A multithreaded processor according to Claim 24, 
. wherein 

the priority designating means comprises 
a control register including priority fields which 
30 can be set for each instruction stream in each 

execution mode by a special instruction in an 
instruction stream, and 

one of the functional units detects the instate-' 
tion stream and its execution mode corre- 
35 sponding to the instruction decode means that 

has issued the special instruction, and sets the 
priority level into the priority field corresponding 
to the detected instruction stream and execu- 
tion mode, in accordance with the special in- 
40 struction. 

32. A multithreaded processor according to Claim 31, 
wherein 

the special instruction is made up of only an 
45 operation code, and indicates whether the priority 
level should be raised or lowered. 

33. A multithreaded processor for executing multiple in- 
struction streams simultaneously and independent- 
s' |y of each other, comprising: 

a plurality of functional units for executing in- 
structions simultaneously and indep nd ntly of 
eachoth r; 

55 a plurality of instruction decode means, corre- 

sponding to the multiple instruction str ams on 
a one-to-one basis, for respectively fetching 
and decoding an instruction of each instruction 
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stream, and sp cifying to which functional unit 
the instruction should be issued; 
priority designating means for designating the 
priority level of each of the multiple instruction 
stream, and designating whether each instruc- s 
tion stream should be in an execution state or 
in a halt state; 

instruction issue judging means for judging 
whether the decoded instruction can be issued 
to the specified functional unit, depending on 10 
whether the specified functional unit is ready to 
receive an instruction; and 
instruction issue arbitration means for arbitrat- 
ing between two or more instructions to deter- 
mine one instruction to be issued to the f unc- *5 
tional unit specified by the two or more instruc- 
tion decode means, in accordance with the pri- 
ority levels designated by the priority designat- 
ing means. 

20 

34. A multithreaded processor according to Claim 33, 
wherein 

the priority designating means comprises: 

a first register for holding the priority level of 25 

each instruction stream that can be set by a first 

instruction; 

a second register for holding a status flag of 
each instruction stream indicating whether 
each instruction stream is in an execution state 30 
or in a halt state, the status flag being set by a 
second instruction; and 
a third register for holding an exclusive halt flag 
of each instruction stream which orders to halt 
other instruction streams, the exclusive halt 35 
flag being set by a third instruction, and 
the instruction issue judging means judges that 
the instructions in the halted instruction 
streams cannot be issued, in accordance with 
the status flag and the exclusive halt flag. *o 

35. A multithreaded processor according to Claim 34, 
wherein 

the first instruction is made up of only an oper- 45 
ation code for indicating whether the priority 
level should be raised or lowered, 
the second instruction is made up of only an 
operation code for indicating whether the prior- 
ity level should be raised or lowered, 50 
the third instruction is made up of only an op- 
eration code for indicating that other instruction 
streams should be halted, and 
one of th functional units det cts the instruc- 
tion str am corresponding to th instruction de- 55 
code means that have issu d the first, second, 
and third instructions, and changes the priority 
level, the status flag, and the exclusive flag cor- 



responding to the detected instruction stream. 

36. A multithreaded processor for executing multipl in- 
struction streams simultaneously and indep ndent- 
ly of each other, comprising: 

a plurality of instruction cache means for tem- 
porarily storing instructions of the multiple in- 
struction streams; 

a plurality of instruction fetch means, corre- 
sponding to the multiple instruction streams on 
a one-to-one basis, for respectively fetching an 
instruction of each instruction stream from the 
instruction cache means; 
priority designating means for designating the 
priority level of each of the multiple instruction 
stream; and 

instruction fetch control means for arbitrating 
between instruction fetch requests issued by 
two or more instruction cache means, in ac- 
cordance with the priority levels designated by 
the priority designating means. 

37. A multithreaded processor provided with a plurality 
of functional units for executing instructions, a plu- 
rality of instruction decode means for respectively 
decoding an instruction fetched from an instruction 
cache means and outputtingan instruction issue re- 
quest to a designated functional unit, and the same 
number of register sets as the instruction decode 
means, which executes the same number of in- 
struction streams as the instruction decode means 
simultaneously and independently of each other, 
characterized by comprising: 

holding means for holding the priority level of 
each instruction stream that can be set by an 
instruction in each instruction stream; and 
control means for arbitrating between two or 
more instruction streams sharing the same re- 
source, in accordance with the priority levels, 
the shared resource being one functional unit 
for which instruction issue requests from two or 
more instruction decode means compete : one 
instruction cache for which fetch requests from 
two or more instruction decode means com- 
pete, or one register set for which access re- 
quests from two or more functional units com- 
pete. 

38. A multithreaded processor according to Claim 37, 
wherein 

upon receipt of an instruction to raise or lower 
a priority level, one of the functional units changes 
the priority level of the instruction stream to which 
the instruction b longs, the priority level being held 
by the holding means. 
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2£ It should be noted that "x" indicates the logical processor number of 
the instruction issuer, white "y" indicates each of other logical 
processor numbers. 



29 



EP 0 827 071 A2 




30 



EP 0 827 071 A2 



DJD 



OO 
CO 

Di 

o 

O 
tU 
I 

UJ 
00 

o 

H 

a 



< 
o 

OO 

H 
O 

a 

00 



CO 



CO 

2 



2 
O 

E -1 
O 
ID 

H 

00 

< 

o 

O- 

OO 



CO 

Di 
O 
-JOO 

OO 

Oct: 



o 

H 
H < 
O 



2 
O 



H 
O 



< 

Cu 

O 

o 



o 
o 



CO 

2 



o 
o 



CO 

2 



CO 



co 



00 



O 



31 



EP 0 827 071 A2 



Fig. 15 



100 




INSTRUCTION FETCH 
CONTROL UNIT 



A ) 


\ 


> 






> 


< > 






N 












V 



INSTRUCTION 
DECODE UNIT 



111 



PRIORITY 
CONTROL 
UNIT 

60 



v v 



INSTRUCTION 
DECODE UNIT 



112 



v v 



INSTRUCTION 
DECODE UNIT 



113 ±± 



INSTRUCTION ISSUE 
CONTROL UNIT 



v v 



20 



v v 



V V 



21 



22 



v v 



150 



FUNCTIONAL 




FUNCTIONAL 




FUNCTIONAL 




FUNCTIONAL 


UNIT A 




UNFTB 

1 1 




UNITC 




UNITD 



23 



REGISTER CONTROL UNIT 



A A 



REGISTER 
GROUP 



A A 



131 



REGISTER 
GROUP 





A A 



170 



REGISTER 
GROUP 



132 



133 



32 



(19) 



Eur paisches Pat ntamt 
Eur peart Patent Offlc 
Offic ur peen d s brevets 



(12) 



(88) Date of publication A3: 

20.01.1999 Bulletin 1999/03 

(43) Date of publication A2: 

04.03.1998 Bulletin 1998/10 

(21) Application number: 97306565.9 

(22) Date of filing: 27.08.1997 



(H) EP 0 827 071 A3 

EUROPEAN PATENT APPLICATION 

(51) mt ci * G06F 9/38, G06F 9/46 



(84) 


Designated Contracting States: 


(72) 


Inventors: 




AT BE CH DE DK ES Fl FR GB GR IE IT U LU MC 


• 


Ktmura, Kozo 




NL PT SE 




Osaka-shi, Osaka-fu 533 (JP) 




Designated Extension States: 


• 


Kiyohara, Tokuzo 




AL LT LV RO SI 




Osaka-shl, Osaka-fu 545 (JP) 






• 


Yoshioka, Kousuke 


(30) 


Priority: 27.08.1996 JP 224720/96 




Neyagawa-shi, Osaka-fu, 572 (JP) 


(71). 


Applicant: MATSUSHITA ELECTRIC INDUSTRIAL 


(74) 


Representative: Crawford, Andrew Birkby et al 


CO., LTD. 




A. A. THORNTON & CO. 




Kadoma-shl, Osaka 571-8501 (JP) 




Northumberland House 






303-306 High Holborn 








London WC1 V 7LE (GB) 



(54) Multithreaded processor for processing multiple instruction streams independently of each 
other by flexibly controlling throughput in each instruction stream 



(57) A multithreaded processor for executing multi- 
ple instruction streams is provided. This multithreaded 
processor includes: a plurality of functional units for ex- 
ecuting instructions; a plurality of instruction decode 
units, corresponding to the multiple instruction streams 
on a one-to-one basis, for respectively decoding an in- 
struction, and Producing an instruction issue request for 
designating to which functional unit the decoded instruc- 
tion should be issued and requesting for the issuance 
of the decoded instruction to the designated functional 
unit; a holding unit for holding the priority level of each 
instruction stream; and a control unit for deciding which 
decoded instruction should be issued to a functional unit 
designated by two or more instruction issue requests at 
the same time, in accordance with the priority levels held 
by the holding unit. 



Fig. 2 




Prrited by Jouve. 75001 PARIS (FR) 



EP 0 827 071 A3 




European Patent 
.Office 



EUROPEAN SEARCH REPORT 



EP 97 30 6565 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation of document with indication, where appropriate. 
of relevant passages 



HIROAKI HI RATA ET AL: "AN ELEMENTARY 
PROCESSOR ARCHITECTURE WITH SIMULTANEOUS 
INSTRUCTION ISSUING FROM MULTIPLE THREADS- 
COMPUTER ARCHITECTURE NEWS, 
vol. 20, no. 2, 1 May 1992, pages 136-145, 
XP000277761 

* page 136. left-hand column, line 1 - 
page 142, left-hand column, last line * 



US 5 430 851 A (HI RATA HIROAKI ET AL) 
4 July 1995 

* column 2, line 61 - column 3, line 63; 
claim 1; figure 2 * 



FARCY A ET AL: "IMPROVING SINGLE-PROCESS 

PERFORMANCE WITH MULTITHREADED PROCESSORS' 

PROCEEDINGS OF THE 1996 INTERNATIONAL 

CONFERENCE ON SUPERCOMPUTING, 

PHILADELPHIA, MAY 25 - 28, 1996, 

no. CONF. 10, 25 May 1996, pages 350-357, 

XP000683043 

ASSOCIATION FOR COMPUTING MACHINERY 
* page 350, left-hand column, line 1 - 
page 353, left-hand column, line 15 * 

US 5 546 593 A (KIMURA K0ZO ET AL) 
13 August 1996 



* column 2, line 15 
figures 1,8 * 



column 4, 1 ine 22; 



WO 98 02799 A (ADVANCED MICRO DEVICES) 

22 January 1998 

* abstract; figure 2 * 



The present search report has been drawn up tor all claims 



Relevant 
to claim 



CLASSIFICATION Of THE 
APPLICATION 0M.CI.6) 



1,5,6, 
23-27, 
37,38 



2-4, 
13-16. 
33 , 36 

1,5,6, 

23-27, 

37.38 

2-4, 

13-16, 

33,36 

1,23-25, 
36,37 



G06F9/38 
G06F9/46 



TECHNICAL FIELDS 
SEARCHED (tnLCI.6) 



G06F 



13,14,33 



2-4, 

13-16, 

33,36 



1-38 



Place d awct\ 

MUNICH 



Date of comptotfon or the search 

23 November 1998 



Examner 

Thibaudeau, J 



CATEGORY OF CITED DOCUMENTS 

X : particularly relevant it taken alone 

Y : particularly relevant (I combined wfth another 

document of the same category 
A : technological background 
O : non-mitten disclosure 
P : Intermediate document 



T : theory or principle underlying the invention 
E : earlier patent document, but published on, or 

after the fifing date 
D : document cited in the application 
L : document cited for other reasons 



& : member of the same patent famSy. corresponding 
document 




